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ABSTRACT 


In this thesis, we present a method of automatically generating a route of flight for 
an aircraft, or a group of aircraft flying in formation, from an origin to a destination in the 
presence of threats. The threats encountered at a point of the route are a function of the 
route used to arrive there. The route is constrained by limits on one or more resources, 
such as fuel and time, expended over the course of the route. We use a C++ program to 
implement the method for two scenarios. In the first scenario, we generate optimal routes 
for a path-dependent radar threat environment. We then compare these results with 
routes generated for a path-independent radar threat. In a second scenario, we generate a 
route for a three-dimensional airspace over terrain in the presence of two constraints and 
multiple threats that vary dependent upon the route taken. The computing time required 
to generate a route is sufficiently short for use of the method in mission planning tools. 


Recommendations for future research and model improvement conclude the thesis. 
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EXECUTIVE SUMMARY 


In this thesis, we present a method of automatically generating a route of flight for 
an aircraft, or a group of aircraft flying in formation, from an origin to a destination in the 
presence of threats. The threats encountered at a later point of the route are a function of 
the route used to arrive there. The route is constrained by limits on one or more 


resources, such as time and fuel, expended over the course of the route. 


We model the airspace as a directed network in which the nodes of the network 
represent potential waypoints in three-dimensional airspace, and the arcs represent 
segments of flight between waypoints. Since the magnitude of the threat at any point is a 
function of the route used to arrive there, the probability of mission success while 
transiting along an arc depends on the arcs used in the route. We formulate a Path- 
dependent Constrained Shortest-Path Problem (PCSP) to find the route of flight with the 


maximum probability of success. 


We solve the PCSP problem in two stages. In the first stage, we relax the PCSP 
problem by eliminating the path dependency in the objective function and formulate an 
integer linear program. This integer program is a discrete shortest path problem with side 
constraints. Through the technique of Lagrangian Relaxation, we incorporate the side 
constraints into the objective function, resulting in a discrete shortest-path problem. We 
then solve this shortest-path problem by using a label-correcting shortest-path algorithm. 
The Lagrangian relaxation solution provides us with a bound on the optimal value of the 


PCSP. We may also have obtained a feasible path satisfying our side constraints. 


The second stage utilizes the solution obtained in the prior stage. In this stage, we 
enumerate paths from our origin to our destination. In the course of enumeration, we use 
the true path-dependent probabilities of mission success. We use bounds obtained by 
feasible solutions and Lagrangian Relaxation to limit the enumeration. Any time we find 
another solution with a better objective function value, we improve a bound that further 
limits enumeration. When we have completed the enumeration process, we will have 


obtained our optimal path. 


Xlil 


We then present two scenarios to illustrate the solution strategy. In the first 
scenario, we compare the optimal routes when modeling Surface-to-Air Missile (SAM) 
threats in a path-independent manner to optimal routes when modeling SAM threats in a 
path-dependent manner. In the path-independent model, SAM threats consist of 
concentric range circles with increasing probability to shoot down an aircraft. In the 
path-dependent model, the probability to shoot down an aircraft increases at an increasing 
rate of the amount of time in the SAM range. Optimal routes in the path-independent 
model, seek to reduce the amount of time in the inner most SAM range circles. In these 
areas, the probability of shooting an aircraft down is higher than the outer annulus shaped 
regions. In the path-dependent model, optimal routes seek to reduce the amount of time 
spent within range of a SAM, regardless of the route location within the range circle. Air 
intelligence planners now have two different methods modeling radar threats. They can 


select the method that best fits a particular environment. 


In the second scenario, we generate a three-dimensional route for an aircraft from 
origin to destination in the presence of multiple radar threats and locations where enemy 
may observe and react to the flight. The enemy may observe aircraft from three 
locations. Flight within visual range of these locations for an extended period, or flight 
over more than one of these locations within a given time window will result in a large 
risk of being shot down by the enemy. Rather than avoiding all locations of enemy 
activity, planners can determine the optimal route. This route may include flight over 
some enemy locations. This feature is particularly useful in situations with dense 
concentrations of enemy activity. The computing time required to generate a route in 


these scenarios is sufficiently short for use of the method in mission planning tools. 
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I. INTRODUCTION 


A. BACKGROUND 


A crucial component in mission planning for aviation units is to determine the 
route aircraft will take into and out of an objective. While the aircraft traverse the route, 
they consume limited resources such as time, fuel and ordnance. Additionally, each 
portion of the route contributes toward or detracts from the probability of mission 
success. If the enemy observes the flight of aircraft and accurately judges the flight’s 
intent, he can take steps to thwart its mission. These steps include attacking the aircraft 
to prevent them from reaching their destination, or reinforcing or relocating their targeted 
objectives. Thus, in developing his plan, the Air Mission Commander (AMC) faces the 
challenge of selecting the route for each aircraft that maximizes the probability of 


mission success while consuming no more than the aircraft’s allotted resources. 


Vital coordination for fire-support and communications and control depend upon 
integration by orders issued from higher headquarters. Higher headquarters cannot 
complete and issue their orders until they have received a briefback from subordinate 
units detailing their plans (FM 90-26, 1990). These integration requirements constrain 
the amount of time the AMC has to issue orders to aviation units. Thus, planners exploit 
any automation available in order to plan the flight route as swiftly as possible. The 
current automation tool employed by Navy and Marine Corps flight planners is Falcon 
View (FalconView, 2007). This is a flight-planning package allowing overlays of threat 
information and command and control airspace on maps and charts. However, the route 
of flight must be manually determined based solely upon the expertise and judgment of 
the planners. Planners input the route, utilizing Falcon View to generate flight packets 
containing the route, command and control measures, and other information upon which 


aircrew rely to navigate their flight. 


Unmanned Aerial Vehicles (UAVs) typically accomplish high-risk missions. At 
present, even the routes of these aircraft are determined based on human judgment and 


the technical expertise of the UAV controllers. UAV route planners operate under the 
1 


same urgency as planners for manned flights, since they must also submit their selected 
route to higher headquarters in order to integrate command and control and fire-support 
assets. Thus, driven by intense time pressure, UAV mission planners, like AMCs for 
manned missions, may select routes with a less than optimal probability of mission 


SUCCESS. 


Planners select routes for manned and unmanned missions based on certain 
assumptions and experience in order to speed their decision-making. In relying on 
experience, planners may fall prey to the error of choosing a route used in a successful 
previous mission. In so doing, they fail to take into account the fact that they are up 
against an intelligent adversary who also may be planning their course of action based 
upon previously flown routes. Repeated flights along the same route will unnecessarily 
expose the aircraft to the threat of ambush by the enemy, due to the predictability of the 
mission’s route. Planners might attempt to mitigate the threat of enemy ambush by 
entirely avoiding a previously flown route, but in so doing, expose themselves to other 
types of threats. If a planning tool were available which would enable planners to 
quantify the risk of flying over only portions of a route previously flown, they could 


generate a route optimally balancing the threat from predictability with other threats. 


Additionally, planners may assume that conditions at a point along the route will 
not change regardless of how the flight arrived at that point. Again, this assumption does 
not take in to account conditions that change resulting from the flight itself. Changes in 
threat might result from different environmental conditions, such as weather or lighting 
conditions, which depend on the flight’s arrival time at this point. As an example, if the 
moon is low on the horizon, one side of a prominent terrain feature might be well 
illuminated. On the illuminated side, the threat of striking an obstacle or a pilot error due 
to high workload would be much lower than the side in shadow. As time progresses, the 
lunar position in the sky changes and might reverse these environmental threats. Hence, 
routes that differ in time of arrival to a certain point will face different conditions at that 


point (see Figure 1). 





Early Conditions Later Conditions 





Figure 1. Changing Moon Position Leaves Different Areas in Shadow 


Threats from enemy radars at a particular point may also depend on the route 
taken to that point. For example, the radar threat might increase the longer an aircraft 
remains within range of the radar. Thus, missiles guided by the radar will shoot the 
aircraft down with a lower probability when it first enters radar range than after tracking 
the aircraft for some time. In this situation, the route of flight to a particular point within 


the radar range has a large effect on the magnitude of threat encountered at that point. 


In the preceding examples, future threats depend upon the earlier choice of route. 
Planners know these threats and their dependence on the selected route, but due to the 
limited amount of time they have to plan the route, they cannot fully utilize this 


information in flight planning. 


Current mission planning software in use by Navy and Marine Corps aviation 
units does not incorporate an automatic route generator. There are several automatic 
route generators in existence, such as CLOAR (CLOAR, 2007), OPUS (OPUS, 2007), 
and JRAPS, but all of them have a number of modeling and computational shortcomings 
thoroughly discussed by Carlyle, Royset and Wood (2007a). Additionally, none of these 


automatic route generators account for threat dependencies. 


In this thesis, we present a method of automatically generating a route of flight for 
an aircraft, or a group of aircraft flying in formation, from an origin to a destination in the 
presence of threats. The threats encountered at a point of the route are a function of the 
route used to arrive there. The route is also constrained by limits on one or more 


resources expended over the course of the route. 


B. LITERATURE SURVEY 


An automatic route generator for path-dependent environments must address two 
types of problems handled separately in previous studies. The first type of problem 
consists of finding the resource constrained shortest path between two points. In this 
case, a path is feasible only if travel along a path consumes no more resources than 
allowed by specific capacities. We call this the constrained shortest path problem. The 
second type of problem is concerned with finding an optimal route when the threats at a 
point depend upon the sub-path to that point. This is the path-dependent shortest-path 


problem. 


1. Techniques to Solve Continuous and Discrete Constrained Shortest- 
Path Problems 


Current studies employ three primary methods of solving the constrained shortest- 
path problem. These methods are calculus of variations, Nonlinear Trajectory 
Generation, and network models. Calculus of variations and Nonlinear Trajectory 
Generation are continuous models describing the trajectory of the aircraft at any given 
moment in time. Network models represent the airspace by a set of discrete points 


between which an aircraft may fly. 


a. Calculus of Variations 


Zabarankin, Uryasev, and Murphy (2006) utilize the techniques of 
calculus of variations in order to find the minimum risk route of an aircraft through an 
area containing one radar threat. This technique provides a continuous solution to the 


problem. Continuous models have an equal or better probability of mission success than 


network models. The higher probability of mission success results from the fact that the 
aircraft may follow a curved trajectory, rather than flying directly from point to point as it 
is restricted to do in a network model. In practice, however, aircraft navigate from point 
to point in three-dimensional space, either over prominent terrain features at set altitudes, 
or between points in the airspace identified through navigational aids such as the Global 
Positioning System (GPS). In order to follow a route determined through the calculus of 
variations, an aircraft might be required to make several quick turns in succession. The 
demands on the aircrew to adhere to this route might increase their chance of missing 
other crucial aspects of the mission, resulting in reduced probability of mission success. 
A second drawback to the calculus of variations method of Zabarankin et al. (2006) is the 
fact that the route is determined in the presence of only one threat to mission success. It 
appears difficult to extend the calculus of variations method to address multiple threats, 


let alone extend it further to address the path-dependent shortest path problem. 


b. Nonlinear Trajectory Generation 


Nonlinear Trajectory Generation (NTG) is a software package developed 
to solve optimal trajectory generation problems for constrained systems (Milam, 2003). 
NTG uses the NPSOL (NPSOL 5.0, 2007) solver as a nonlinear optimization tool in order 
to provide a continuous solution. Misovec, Inanc, Wohletz and Murray (2003) and Inanc, 
Misovec and Murray (2004) use NTG to determine a route for a UAV with maximum 
probability of success in the presence of multiple threats. The main advantage of their 
work is the speed with which NTG arrives at a solution. This speed comes at the cost of 
sensitivity to an initial route selection. Due to this sensitivity, the solutions arrived at 
through this method are guaranteed to be locally optimal, but may not be globally 
optimal. Thus, NTG is best suited for dynamic situations where the task is to modify a 


pre-selected route, rather than a planning tool to find the optimal route. 


c. Network Models 


In using a network model to solve the discrete constrained shortest-path 


problem, Zabarankin et al. (2006) use a label-setting algorithm to find the optimal route. 
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However, in their study, only one constraint on resources and one threat to mission 
success is considered. Carlyle, Royset and Wood (2007b) handle one and two constraints 
on resources, as well as multiple threat sources by using the technique of Lagrangian 
Relaxed Enumeration (LRE) to find an optimal solution. We will build upon LRE in this 
thesis since it is competitive with the label-setting algorithm and readily extensible to 


handle path-dependent situations. 
2. Studies of Path-Dependent Shortest Path Problems 


Tan and Leong (2004) show that path-dependent discrete shortest path problems 
are NP-complete, noting an exponential amount of storage space may be required in order 
to describe the dependency. Orda and Rom (1990) propose several algorithms for 
handling path-dependent discrete shortest-path problems in communications and data 
transmission applications. These studies only seek to minimize total arc length in a path 
through the network and do not consider consumption of resources along this path. Thus, 


their approaches do not readily extend to cases with side constraints on such resources. 


Other studies, such as Davies and Lingras (2003) and Fan, Kalaba and Moore 
(2005), deal with dynamic planning of routes in networks where the path through the 
network affects travel costs between nodes. In this thesis, we consider preplanning of 
routes in their entirety prior to mission departure. The methods of Davies et al. (2003) 
and Fan et al. (2005) are for situations in which a route commences before obtaining all 
pertinent information. They also do not consider side constraints that limit route choice. 
Thus, their techniques are difficult to extend to the aircraft routing problem under 


investigation. 
C. ORGANIZATION 


The remainder of this thesis formulates and solves a model of a discrete path- 
dependent shortest-path problem for aircraft routing, presents solution strategies and 


optimal routes to different path-dependent scenarios. Chapter II presents the 


mathematical formulation of the model and solutions strategies for solving it. Chapter III 
compares results using a path-independent model and a path-dependent model. Chapter 
IV presents a three dimensional path-dependent scenario. Chapter V concludes the thesis 


and suggests areas for future research. 
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Hi. MODEL FORMULATION AND SOLUTION STRATEGY 


A. AIRCRAFT ROUTING MODEL 


The airspace is modeled as a directed network G = (N JE ) in which the nodes of 


the network ne WN represent potential waypoints in three-dimensional airspace, and the 
arcs (i, /)€ E represent segments of flight between waypoints, from node 7 to node /, 
where i,j ¢N. The aircraft’s entry point into the modeled airspace is labeled as node 
sé€WN and its destination by the node te N. We define an s-t path, P(s,t), to be a 
sequence of nodes from s to t, s=i,,i,i,,...,j, =t. This sequence of nodes represents a 


series of arcs used to travel from one node to the next in the sense that for any two 


consecutive nodes 7, and i,,, in the path, (7,,i,,,)¢£. We denote the set of all paths 


1 ytl 


from s to ¢ £(s,t). Define a sub-path of P(s,t) that starts at s by 


P(S,i): 8 =1,,i,,1,,...,1,, =i, where m is a natural number with m<k. We indicate an 


arc (i,,i,,,)€E shows up on a path by the symbol (i,,i,,,)¢P(s,t). If no nodes are 


repeated in the (sub)path, we then call it a simple (sub)path. 


A path represents a route for the aircraft between s and ¢. Current doctrine 
views revisiting waypoints in a route as unattractive due to the increased likelihood of 
drawing enemy fire. Since the nodes of the network represent waypoints for an aircraft 
route of flight, a path that takes in to account this doctrinal preference would not repeat 
any nodes. Thus, in this thesis we only consider simple paths and sub-paths. In 
principle, the methods in this thesis could handle non-simple paths, but to do so may 


cause weakening of bounds in path-enumeration and is beyond the scope of this thesis. 


Each arc (i, j) € E has data associated with it. The primary data is the probability 
of success while transiting this arc. This probability of mission success is a function of 


the sub-path taken to arrive there and the arc itself: 


qii.j) = $(P(s,i),(i, i) (1) 


Secondary data for each arc, denoted weights, represent additive metrics such as fuel, 
time, and ordnance. Let K be the total number of secondary weights for an arc. Then, 
for a given arc, (i, j)EE, fia fines te represent these weights. The aircraft has a 
limited capacity for each of these weights, for instance representing the total amount of 
fuel, mission time and ordnance available. We let g, be the upper limit on the 


i-th weight along a path. We obtain an optimal route, P*(s,t)e #(s,t), by solving the 


following optimization problem: 


= max q, ; Objective Function (2) 
PUSDE FEUD es Depis.t) bd) 
subject to y fay <g,, Vk =1,2,....K Side Constraints (3) 
(i, j)EP(s,t) 


In order to compare results from this optimization problem to future relaxations, we now 
perform a logarithmic transformation to our objective function. Since the logarithm 


function is monotonically increasing, we can equivalently consider the problem: 


C'S poll apt [ T, ij) Objective Function (4) 
subject to : x Sion eae oes a Side Constraints (5) 
i, j)eP(s,t 


The values of (4) are all non-positive. Equivalently, we opt to minimize the negative 
value of the objective function in (4). We then obtain the Path-dependent Constrained 


Shortest-path Problem (PCSP) defined as follows: 


C= Hae i —In (4.) Objective Function (6) 
subject to ~ fay <g,, Vk=1,2,....K Side Constraints (7) 
(i, j)eP(s,t) 


where ¢" is the logarithmically-transformed optimal probability of mission success. We 


note the optimal value of (2-3) relates to the optimal value of (6-7) in the following 


manner: 
¢ =exp(-¢") (8) 
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We now present our solution strategy to solve the PCSP. 
B. SOLUTION STRATEGY 


We solve the PCSP problem in two stages. In the first stage, we relax the PCSP 
problem by eliminating the path dependency in the objective function and formulate an 
integer linear program. This integer program is a discrete shortest path problem with side 
constraints. Through the technique of Lagrangian Relaxation (Ahuja, Magnanti & Orlin, 
1993, pp. 598-638), we incorporate the side constraints into the objective function, 
resulting in a discrete shortest-path problem. We then solve this shortest-path problem 
using a label-correcting shortest-path algorithm. The Lagrangian relaxation solution 
provides a lower bound on the optimal value of the PCSP. We may also have obtained a 


feasible path satisfying our side constraints. 


The second stage utilizes the solution obtained in the prior stage. In this stage, we 
enumerate paths from the origin to the destination. In the course of enumeration, we use 
the true path-dependent mission success probabilities. Enumeration of feasible paths 
that do not violate our side constraints is limited by using the upper bound obtained by a 
feasible solution and a lower bound obtained from the Lagrangian Relaxed solution. Any 
time we find another feasible solution with a better objective function value, we update 
the upper bound and use this new value to limit our enumeration. When we have 


completed the enumeration process, we will have obtained the optimal path. 
1. Integer Program Formulation and Lagrangian Relaxation 


The first step in stage one is to define of “best-case” risks. We eliminate the path 
dependency by assigning the minimum value of all possible “risks” that can be 


experienced at an arc. Thus, for a given arc, (i so ) € E., we define a risk-unit as: 


ee a porn. |—In(au.») | (9) 


This risk-unit is path-independent, corresponding to the most favorable probability of 


success when transiting arc (i, j) that can possibly occur. 
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We now follow the method of Carlyle et al. (2007b), assigning an order to all arcs 


(i, j)€ E, labeling them e,,...,e,,, and designating a vector of risk unitsc=|c,,...,c,_ }. 
1 IE g g e 


lq, 
We let x be a binary vector with dimension |E|x1. An entry of 1 in x signifies a 


particular arc will be traversed, whereas an entry of zero signifies it will not. Let A be 


an IN|x|E| incidence matrix for G such that if e=(i, j)¢E£, then A, =1, A, =—1, and 
A, =0 for all we N\{i, j}. Form an |N|x1 balance of flow vector b such that b, =1, 
b =-1, and b,=0 for all ic N igs) . Now for each constraint, we collect the 
constraint weights, fay , into a row vector, fi. , where K designates the total number of 
constraints. We then collect these row vectors into a K x|E| matrix F where each row 
corresponds to one of the constraints. Finally, we let g= [ Sink “ii be the vector of 
constraint limits. 


We now utilize this data and nomenclature in order to formulate the path- 
independent integer linear program required for stage one of our solution strategy. This 


discrete constrained shortest-path problem (CSPP) is: 


Sets: 

N: Nodes 

E: Arcs 

Parameters: 

A: incidence matrix 

F: constraint matrix 

b: balance of flow vector 
g: constraint limit vector 
Cc: risk-unit vector 


Decision variable: 
xe {0,1} 


Constraints and objective function: 
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z=minex Objective function (10) 
subject to Ax =b Balance of Flow Constraints (11) 
Fx <g [4] Side Constraints (12) 


Any binary vector x satisfying Ax=b uniquely defines a path from s to t. Since 


Cu.) 2 0 for all (i, 7 ) € E there always exists an x defining a simple path. 


In the final step of the first stage, the Lagrange multiplier 2, a 1x K vector, is 
used to relax the CSPP by incorporating the constraints into the objective function. The 


resulting Lagrangian-relaxed program is as follows: 

z(A) = min cxt+2(Fx-g) Objective function (13) 

subject to Ax=b Balance of Flow Constraints (14) 
For any fixed 2, the Lagrangian-relaxed program, consisting of (13) and (14), is a 


shortest-path problem, referred to as LRSPP, which can be solved quickly (Ahuja et al., 
1993, pp. 598-638). The optimal solution obtained, x,,, provides a lower bound 


z=cx,, for the PCSP. Seeking to find the greatest lower bound possible, we solve the 


following Lagrange multiplier optimization problem: 


z= max min cx+2(Fx-g) Objective function (15) 
subject to Ax=b Balance of Flow Constraints (16) 


The optimal solution, z’, to this program is the greatest lower bound for our LRSPP and 


PCSP. In the course of finding this lower bound, we may have found a feasible solution 


X that satisfies our side constraints. 
If X is a feasible solution that satisfies our side constraints (12), it represents a 
corresponding unique simple path, P(s,t), from s to ft. We now compute an upper 


bound, z, for our PCSP using the true path-dependent probabilities of success along an 


z= ate (i,j) oe 
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If no feasible solution has been located, we can still calculate a weak upper 
bound. In order to do so, we must determine the maximum number of arcs that can be 


traversed in a path from s to t. In order to determine this number, for all k, 1<k<K, 


we let 7, =g,/f., where f., =min { fi leek \ . The maximum number of arcs which 
are traversed is 77,,, =max {7, ll<k<K \. Our PCSP upper bound then becomes, 


Z=MnaxCmax >» Where and c,,,, =max{c, lee E}. 


2. Enumeration 


The next stage is to begin enumerating possible paths P(s,t) ef (s,t) by 
creating a sub-path, which we hope to extend through the addition of arcs into a path 
from s to t. We cease extending this sub-path, if we can project that we will violate the 
side constraints or we will not improve our current best solution. If we find a feasible 
path which improves our value for z , then we update our upper bound and retain that 
particular path as our candidate for our optimal solution. When we have exhausted this 


process, the best path we have found during enumeration is the optimal solution to the 


PCSP problem. 
In the process, we keep track of several values for our current sub-path. These 
values are R, L and G, where k =1,2,...,K representing the total risk, Lagrangian- 


relaxed risk, and total amount of resource k we have consumed on our current sub-path, 


respectively. We define the Lagrangian-relaxed risk as the contribution to the value of 
z in (14) from transiting along an arc, c'=c+AF. To begin enumeration we set the 


value of L to —Ag and all other values to zero. 


Now, for all nodes ie N \{r} , we calculate the minimum quantities required to 


travel from i to t. The quantities r(i ) me ) ,and d, (i ) denote the minimum amount of 


risk units, Lagrangian-relaxed risk units, and resource k, for all 1<k < K,, required in all 
possible paths from node i to node t. This process is simply K+2_ shortest-path 


calculations carried out backwards from t. Now we use a Last-In-First-Out data 
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structure called a stack to keep track of our sub-path. Beginning at our origin node s , we 
consider an are (i, j)¢E departing our current node, ie N. First, we label this arc as 


“seen.” We determine if we have met the following four conditions: 


1. We cannot have previously been through node j in our current sub-path. 


2. R -In(q.,))+ r(j)<Z, where 4i.i) = O(PUD.(G i)) and P(s,i) consists of the arcs 


in the sub-path. 
3. L=In(qy,)) +f) +1) SZ 
4. G, fs +d,(j)<g, for all arc weights k =1,2,...,K. 


If these conditions are satisfied, we extend our sub-path to node j by placing arc 
(i Fe ) on our stack. We update our path values by adding the risk unit and side constraints 
to the previous values. If 7 =t, we update z=R. If the conditions are not satisfied, or 
j =t, we now repeat the process considering the next arc leaving from our current node 
which we have not previously labeled as “seen.” 

When we have labeled all the arcs leaving our current node as “seen,” we step 
back to the previous node. In order to accomplish this we backtrack to the second to last 


node on our sub-path. To accomplish the backtracking we remove the top arc, (i, J ) 


from our stack. We update our data as follows: 


1. R=R+In(q,)) 


hes 


L=L+In(q,))—My, 


) 
3. G,=G, =f) for all arc weights k =1,2,...,K 


4. We remove our “seen” label from all arcs leaving node /. 


Our enumeration will end once we have backtracked to our origin node s and we 


have previously labeled all departing arcs at s as “seen.” At this moment, we will have 
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obtained the optimal path from s to t for PCSP. We can also choose to terminate our 
enumeration early by allowing a certain tolerance, ¢. When we have obtained a path 
from s to ¢t which results in a corresponding total risk value, R, that is within this 
tolerance percentage of our lower bound obtained through Lagrangian relaxation, 


R-z<&, we cease enumeration. 


3. Preprocessing 


We can reduce the size of the network by utilizing the preprocessing techniques 
outlined by Dumitrescu and Boland (2003) and Carlyle et al (2007b). These techniques 
improve upon those proposed by Aneja, Aggarwal, and Nair (1983), identifying arcs in 
the network that never lie on an optimal path and removing these arcs from the network. 


To determine if a given arc, (@, ji) € E,, could be deleted from the network, for a given 
side constraint g,, where 1<k<K, we compute the minimum amount of constrained 
resource required to arrive at node i from node s, D, (i ). We have already computed 
the minimum amount of resource required to proceed from node j to node f, d, ( J ) rap 
D, (i) + ea +d,(j)>,. (i,j) cannot be on a feasible path and we delete (i, j) from 


the network. We repeat this process with all arcs and all side constraints until no more 
arcs can be deleted. When we have obtained an upper bound, Zz, we also apply this 
procedure utilizing the values of our risk-unit vector ¢ instead of our constrained 


resource and replacing “> g,” with “> Zz” in our comparison equation. This process will 
be repeated several times because removal of some arcs may alter the values for D, (i) 


and d, (i) foranode ie N. 


As we proceed with enumeration, we can use improvements in the value of our 
upper bound in additional rounds of preprocessing. Should the value of our upper bound 
decrease by a predetermined percentage, 6, over the course of enumeration, we can 
repeat the preprocessing procedure in an attempt to further reduce enumeration. In order 


to accomplish multiple preprocessing, we store our initial upper bound value as, Z 


initial * 
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After performing an update to our upper bound value, if Z7<06-Z,,,,,,, we Ppreprocess 
again by performing the following steps: 
1. Compute the minimum total risk units as defined in (9) required to arrive at all nodes 


ie N\{s} from node s, M (i). 


2. Dag = a 

3. Forall (i, j/)e£, if M (+e) +r(j)>Z, remove (i, j) from the network. 

Repeat these three steps until no more arcs can be deleted. 

Now, for all nodes ie N \{t}, we recalculate the minimum quantities r(i), (i ) , and 
d, (i), for all 1<k < K, required in all possible paths from node i to node t. Now, we 


continue enumeration as described above. 
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Ii. COMPARISON OF F/A-18 STRIKE MODELS 


This scenario considers routing an F/A-18 strike aircraft at a level altitude 
between two points in the presence of multiple radar threats. Carlyle et al. (2007a) 
present a similar scenario under the assumption that the radar threats are independent of 
the path taken. As we will see in this chapter, modeling the radar threat as an increasing 
function of time that increases at a rate proportional to the amount of time the aircraft is 


within the radar’s detection range results in differing optimal routes. 
A. PATH-INDEPENDENT MODEL 


In the path-independent model, Carlyle et al. (2007a) formulate a constrained 
shortest-path problem on a network consisting of a highly connected grid of nodes. They 
model the airspace under the assumption that the aircraft will travel at a level altitude. 
Thus, a 26x38 grid of nodes with a spacing of eight nautical miles (nm) represents a 200 
nm by 296 nm airspace. They generate arcs from a node to all other nodes between 16 
nm and 120 nm, inclusive, in distance. They use the Euclidean distance of the arc as a 


surrogate for fuel consumed. Fuel consumption is the only constraint on route selection. 


The sources of risk in the model are 15 surface-to-air missile (SAM) sites. They 
surround each SAM with two or three concentric circles of differing radii (see Figure 3). 
Aircraft will be shot down at a certain risk per unit of time spent traversing each region. 
The area of highest risk is the center circle, and the threat decreases step-wise in each 
larger annulus-shaped region. For a given arc, ee FE, the probability of successfully 


traversing the arc is denoted qg,. As defined previously, the risk unit for a given arc then 


becomes c, =—In(q,). 


B. PATH-DEPENDENT MODEL 


In the path-dependent model, we construct the network in the same fashion with 


the SAM threats in the same location (see Figure 4). Let o€ {hail} represent one of 


the fifteen different SAMs of Carlyle et al. (2007a). For a given SAM, o, we assign a 
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parameter, p,, representing the capability of that SAM to shoot down an aircraft. Let 
y (z,) be an increasing function of the amount of time, 7, , an aircraft is within the range 
of aSAM o, such that the second derivative of y (z,) with respect to 7, is greater than 
zero. An aircraft will be shot down by SAM o with probability py (z,.) . This leads to 


the following expression for the logarithmically transformed probability of mission 
success for a route as: 
15 


> -In((1-p,y(z,))) (18) 


o=l 

In the first phase of our solution strategy, we minimize the risk unit for a given 
arc (i 7 ) € E by assigning the minimum possible time an aircraft will be in range of each 
SAM. For example, if node i lies within the range of SAM o=1, we assume the 
aircraft flew along the radius intersecting node 7 in order to minimize 7,. Thus, as 
depicted in Figure 2, 7, would be the time required to travel from v to 7 plus the time 


required to travel from i to w. 


ey 


4 





Figure 2. Assigning a value for the minimum time within a SAM 


In our CSPP, Cui) = —In (1 — pV (z, )) . During the enumeration phase, the true amount of 


time the path spends within each SAM is determined to calculate the path-dependent risk 


units. 
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Cy COMPARISON OF RESULTS 


In this comparison, we set the optimality tolerance to zero in order to compare the 
optimal routes between models. We ran both models on a Dell Precision PWS690 Intel® 
Xeon™ CPU 3.37GHz processor, with 3.00 GB of RAM, with programs written and 


compiled using Microsoft Visual C++ Version 6.0. 


Constraint Independent Path-Dependent 
Fuel Units [Time [ Total Risk || Time Total Risk 
(Sec.) (Risk Units) (Sec.) (Risk Units) 


200 
| 320 . . 


320 
325 
336 
345 
350 


Table 1. | Comparison of Different Model Outputs 





Table 1 compares the model run times in seconds and the total risk measured in 
units between the two models. In both models, the total amount of risk units decreases 
monotonically as the amount of fuel units increases. Having more fuel enables the 
aircraft to maneuver the route in order to minimize the risk. The run times for the path- 
dependent model are always longer than the path-independent model. The longer run 
times are due to the necessity of recalculating probabilities when we add arcs to a sub- 
path. Each time we add an arc that passes through the radar range of a SAM we must 
determine the true amount of time the aircraft is within range of the SAM in order to 
determine the risk units for the path. In the path-independent model, re-computing is not 
required. Additionally, the path-dependent model may require more enumeration since 


the objective function is non-linear. 
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Figures 3 and 4 show sample output results, demonstrating the differing paths 
chosen. Optimal routes in the path-independent model (Figure 3), seek to reduce the 
amount of time in the inner most SAM range circles. In these areas, the probability of 
shooting an aircraft down is higher than the outer annulus shaped regions. In the path- 
dependent model (Figure 4), optimal routes seek to reduce the amount of time spent 


within range of a SAM, regardless of the route location within the range circle. 


Since the path-independent model always generates routes in less run time, it 
would be preferred whenever possible over the path-dependent model. In environments 
where the path-dependent model better suits the tactical situation, longer run times would 
be acceptable in order to find the optimal route. With the methods outlined in this thesis, 


air intelligence analysts can now make the appropriate modeling decisions. 


200 nm (26 nodes) 





296 nm (38 nodes) 


Figure 3. Route from the path-independent model constrained by 350 units of fuel. 


Ze 
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IV. MULTIPLY-CONSTRAINED THREE-DIMENSIONAL 
SCENARIO 


In this chapter, we generate a three-dimensional aircraft route from origin to 
destination in the presence of multiple radar threats and locations where the enemy may 


observe and react to the flight. 


A. SCENARIO 


1; Terrain 


The area of interest is a plateau with an elevation of 295 feet cut by a large 
canyon whose floor has an elevation of zero feet (see Figure 4). The area is 120 
kilometers from east to west, by 90 kilometers from north to south. The aircraft seeks to 
travel from the southwest corner at an altitude of 580 feet to the northeast corner at a final 


altitude of 580 feet. 
2. Sources of Risk 


There are two radars (depicted with the white stars in Figure 4) which have a 10 
percent per minute probability of detecting and destroying the aircraft if it is within their 
59.8 kilometers range and the line of sight is unobstructed by terrain. These radars are 
located four kilometers north, 88 kilometers east and 60 kilometers north, 88 kilometers 
east of the southwestern most portion of the airspace. Additionally there are three 
locations (depicted with gray stars) where enemy are suspected to be located. They are 
located 12 kilometers north and 38 kilometers east, 49 kilometers north and 62 kilometers 
east, and 73 kilometers north and 114 kilometers east of the southwestern most corner of 
the airspace. The first two have a maximum observation range of ten kilometers and the 
last has a maximum observation range of seven kilometers, provided they have a clear 
line of sight unobstructed by terrain. The enemy will shoot down aircraft entering these 
detection ranges with a 70 percent probability, if they remain within, or enter another of 


these observation areas after ten minutes of entry or within sixty minutes of departure 
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from one of these areas. Finally, there is a risk per kilometer, p,,,, which decays as you 


climb, representing chance of mission failure due to striking an obstacle or encountering 


small arms fire. Let H,, H,, and U represent the starting altitude, ending altitude and 


distance traveled on the segment of flight represented by an arc, the risk from this source 


of threats on this arc is then given by the equation: 
Pa =5-10°U| exp(-H, )+exp(-H,) | (19) 
This risk is in addition to the risks mentioned previously. 

3. Airspace 


The airspace is broken into a lattice of potential waypoints to which the aircraft 
may fly. The lattice has four possible altitudes in increments of 145 feet, beginning at 
145 feet. The horizontal lattice is spaced at one-kilometer intervals. A lattice point must 
be at least 50 feet above the terrain in order to be a waypoint to which the aircraft can fly. 


These lattice points are the nodes in our network. 


We generate the arcs in our network by connecting a lattice point with 24 other 
lattice points. We connect a given lattice point with points in eight directions on the 
same altitude level and with the 16 directly above and below those eight. Which lattice 
points we actually connect depends upon the arc length size we allow in the north/south 


and east/west component directions. 
4, Aircraft 


The aircraft travels at a constant ground speed of 160 kilometers per hour. It 
consumes fuel at rates of 20 pounds per kilometer when in a climb, 12 pounds per 


kilometer in descents, and 15 pounds per kilometer when in level flight. 
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B. RESULTS 


i Initial Results 


We carried out our computations on a Dell Precision PWS690 Intel® Xeon™ 
CPU 3.37GHz processor, with 3.00 GB of RAM, with programs written and compiled 
using Microsoft Visual C++ Version 6.0. The minimum time required to fly direct from 
the origin to the destination is 59 minutes. The minimum fuel required to fly from the 
origin to the destination is 2359 pounds. In Table 2, we consider side constraint limits 
fixed at a flight time limit of 75 minutes and fuel capacity of 3000 pounds. We set the 


optimality tolerance at two percent. 


Length Number 
East/ North/ of Arcs 
in Route 








Table 2. Run times with varying flight segment lengths. Fuel Capacity 300 Ibs and Flight 
Time Limit of 75 minutes 


In Table 2, run time grows as the flight segment length decreases. As the length 
of flight segment decreases the number of potential paths to enumerate increases. 
Additionally, the number of arcs in a path from the origin to the destination increases as 
the flight segment length decreases. Case number nine had the longest run time of the 
cases listed in Table 2. Decreasing the segment flight length further proved impractical 
as the run times exceeded 24 hours. 


Zh 


Figures 5 and 6 depict the overhead and horizontal views of the route of flight 
when the aircraft flight length is three kilometers in the east and west directions and five 
kilometers in the north and south directions. The route hugs the lower edge of the 
airspace before proceeding north and dropping in to the canyon below the line of sight of 
the surface radars. The route also flies directly over a suspected enemy location; 


however, the aircraft enters and exits their range before they have sufficient time to react. 


kilometers 





20 40 60 80 100 120 
kilometers 


Overhead view of route when fuel capacity is 3000 Ibs and flight time limit is 
75 minutes. The flight segment length is 3 km in the east/west direction and 5 km 
in the north/south direction. 


Figure 5. 
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Altitude (feet) 





Oo 20 40 60 80 100 120 140 160 180 
Horizontal path length (kilometers) 


Figure 6. Horizontal view of route when fuel capacity is 3000 Ibs and flight time limit is 
75 minutes. The solid line represents the aircraft altitude along the route. The 
dotted line represents the corresponding terrain altitude along the route. 


Varying the values of the side constraints also has an effect on the run times. 
Table 3 lists the run time results in seconds for a network that allowed flight segment 
lengths of five kilometers in any of the four cardinal directions while the side constraints 


varied as listed. We set the optimality tolerance at two percent. 


Fuel Flight Time Limit (min.) 


“toy | 6 | | 7% | 7s | oo | es | % | 


33.55 





Table 3. Run times in seconds as fuel capacity and flight time limit vary 
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As the both resources increase in proportion, the run time generally increases. 
There are, however, certain combinations of constraints resulting in faster run times. For 
almost all fuel constraints, a flight time limit of 70 minutes resulted in the longest run 
time. The run times for this mission time limit with fuel resources of 3000 pounds or 
more are too long for realistic use in mission planning. However, modification of the 
creation of the network in the manner outlined in the next section, result in faster run 


times acceptable for employment in mission planning. 
2. Results Following Network Expansion 


In order to improve the method run time, we perform a network expansion. We 


create a new directed network G'= (N E ) , where N' is the expanded set of nodes and 


E' is the expanded set of arcs. In order to accomplish this expansion, we generate 
multiple copies, referred to as levels, of the network formed in the original fashion. Each 


copy represents the time since flight over a location of enemy. 


The ten-minute reaction time of the enemy and the minimum amount of flight 


time along an arc determine the number of levels required. Let fa correspond to the 
flight time for an aircraft along arc (i, j)eE. We generate a_ set 
Q= {0,10} U hay I(i, ji) EE, fia 2 10} . Now for all pairs of elements @,,@, €Q, if 
QO; =@,+@, <10, then replace © with QUi{a,}. As you augment © with a new 


element, you repeat this process until no further augmentation is possible. The total 
number of levels required will increase as the minimum amount of time required to fly 


along an arc decreases. 
We generate the nodes in our expanded network (,i)€N', for all @€Q and 
ieN. The origin node in our network is (0,5) and our destination node is (0,t). We 


generate the arcs in our expanded network as ((a,,),(a,, i)je E'. The arcs in the 


expanded network relate to the arcs in the original network in the following ways: 
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1. At level @=0, for (i, J ) € E,, if node 7 is not a location of enemy, the corresponding 
arc is ((0,i),(0, /)) e€E'. 
2. At level w=0, for (i, j)€ E, if node i is a location of enemy, the corresponding arc 


is ((0,i),(@,j))€£'. Where @, =min{ fi 10}. 

3. At all levels O<@,<10, for (i,j)eE, if j#r, the corresponding arc is 
((@,,i).(@,,j))eE". a, = min}, + fi,o10} 

4. Atlevel w=10, for (i, j)¢ E, if j #1, the corresponding arc is ((10,i),(10, j)) ¢E". 
5. Atall levels w>0, for (i,t) ¢ E, the corresponding arc is ((@,/),(0,t)) € E'. 


This process makes intuitive sense because each level represents the time since the 
aircraft last flew over the enemy. Level w=0 indicates prior flight has avoided enemy 
locations, and level @ =10 indicates it has been ten minutes or longer since flight over a 


location of enemy. 


For an arc ((a,,i),(@,, j))eE ' in the expanded network, the primary data, 


¥ 


© ((ci)(e.3) for all 1<k <K, are related to the primary 


, and secondary data, f ones i)) 


data and secondary data of the original network by the following relations: 


1k _ gk 
1. f \esfon.j)) = Ai. forall 1Sk SK. 
2. C'(4,.i)(0,./)) = (i,j) POF all @,.@, <10. 
2 C(o,),(00.4) = Ci, 3) —In(0.3). 


The third relation is the key to improvements in run time resulting from expansion. Since, 
flight over an enemy location on level @=10 will always result in a 70 percent chance of 
this enemy shooting down the aircraft. This “risk unit” from the enemy, —In (0.3) , is in 
addition to other threats the aircraft might encounter from radar, altitude and small arms 
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fire, Cii.j)* In the network prior to expansion, Ci.) corresponds to the path-independent 
probability of mission success obtained from relaxation of the PCSP in order to formulate 
the CSPP. At level @=10, this relaxation is no longer required. In this scenario, 
constraints of time and fuel on the route preclude reaching the 60-minute time limit for 
threat from the enemy locations to “reset” due to lack of vigilance. If sufficient time and 


fuel allows reaching the 60-minute time limit, further expansion of the network is 


required for appropriate modeling. 
In expanding the network that allowed flight segment lengths of five kilometers in 
any of the four cardinal directions we require 16 levels. In the original network 


|N | = 25111 and |E | =16156. After expansion both the corresponding number of nodes 


and arcs increase by a factor of 16 to |N : = 258496. 





= 401776 and |E' 





Table 4 lists the run time results in seconds after expansion of the network used to 


generate the data in Table 3. We set the optimality tolerance at two percent. 


Flight Time Limit (min. 


(min.) 
Co fs fe ls la 


Some run time values have increased slightly due to the increased network size 





and corresponding increase in computing time for shortest-path calculations, but now all 
run times are low enough for employment of the method in a real-world mission planning 


environment. The most dramatic reduction in run times occurs for the flight time limit of 


70 minutes with fuel capacities of 3000 pounds and 3100 pounds. These run times 
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decreased from 1613 seconds and 6054 seconds to 23.19 seconds and 23.27 seconds, 
respectively. 

These reductions in run times result from an increase in the lower bound obtained 
from the LRSPP, z. Table 5 lists the percentage of improvement in the lower bound 


obtained by the network expansion. 


Flight Time Limit (min.) 


Pe fe[e[sfe[s|[a 


Table 5. | Percentage improvement in lower bound obtained through improved network 
creation 








We improved the lower bound a minimum of 6.02 percent in all cases. The greatest 
improvement of 79.94 percent occurred with a flight time limit of 80 minutes with a fuel 


capacity of 3100 pounds. 
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Vv. CONCLUSIONS AND RECOMMENDATIONS FOR FUTURE 
RESEARCH 


A. CONCLUSIONS 


In this thesis, we have built upon the algorithm developed by Carlyle et al. 
(2007b) as the basis for a method of automatically generating routes for aircraft, taking 
into account parameters that depend upon the route itself. | This method can provide 
optimal routes in computational times fast enough for employment in tactical mission 
planning. Furthermore, the method is flexible enough to take into account terrain 
avoidance, line-of-site calculations for radar and visual detection, and varying aircraft 


speed and fuel consumption. 


A key point revealed in the comparison of F/A-18 strike models is the differences 
obtained in modeling radar threats in a path-dependent or independent manner. Large 
differences in route selection occurred in the differing models. Radar models should be 


re-examined to determine if previous assumptions of path-independence are valid. 


As an added benefit, an automatic route generator would enable an Air Mission 
Commander to perform limited sensitivity analysis of his mission and determine if 
significant improvements in the chance for mission success would occur from requesting 
additional resources. With data gleaned through this rapid analysis, the Air Mission 
Commander could quantify the benefit of any additional resources requested from higher 


headquarters. 


Routes generated by the method developed in this thesis can have a greater 
chance of mission success than those manually generated or those that do not take into 
account path-dependent probabilities. The method run time is sensitive to the threat 
environment but generates routes sufficiently fast, provided the appropriate minimum 
distance for flight segment length is established. There does remain, however, room for 
expansion and refinement in order to provide a workable tool to the fleet. We describe 


such extensions next. 
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B. RECOMMENDATIONS FOR FUTURE RESEARCH 


1. Radar Parameters and Dependency Function 


In the F/A strike model, we chose a dependency function and then assigned radar 
parameters to ensure that an aircraft flying directly into the center of the radar would 
encounter the same amount of risk as in the path-independent model. Air intelligence 
analysts can now build upon the work of this thesis, developing and validating path- 


dependency models for radar threats. 


In addition, the radar models utilized a line of sight determination in assigning 
probabilities, but we did not take environmental factors that might cause attenuation of 
detection probability based upon meteorological conditions into account. Future studies 


might further enhance the radar models in such a fashion. 
2 Illumination Dependencies 


In this thesis, we did not explore a scenario in which a threat to the aircraft 
resulted from changing illumination along the route. Future studies can develop this 
scenario by integrating meteorological illumination models for illumination along the 
route of flight. Such a tool would be useful to planners even in training environments to 


minimize risk when training aviators in the use of night vision devices in flight. 
3. Previously Flown Routes 


We only considered the route from an origin to a destination in this thesis. We 
also assumed that there had been no prior aircraft flights in the area. Over time, the 
enemy might base their actions on a pattern of aircraft activity. Future studies can 
incorporate a higher unit of risk for segments of flight previously flown. Such a 
dependency model would better enable a flight planner to plan not only his egress route 
as well, but also enable planners to utilize information of previous air activity in order to 


balance the threats from predictability, enemy and environment. 
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